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Disposition of Claims 

4) 0 Claim(s) 3-14 is/are pending in the application. 

4a) Of the above claim(s)_is/are withdrawn from consideration. 

5) 0 Claim(s) 7 is/are allowed. 

6) 0 Claim(s) 3-6 and 8-14 is/are rejected. 
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DETAILED ACTION 

1. This communication is a Final Office Action in response to the amendment filed 
on September 16, 2005. 

2. The Examiner acknowledges the cancellation of Claims 1 and 2. 

3. Claims 3-14 are presented for examination following the amendment of 
September 16, 2005, of which Claims 3, 7, 10 and 11 are independent claims. 

4. Claims 3-6 and 8-14 are rejected under 35 U.S.C. 103(a). 

5. Claim 7 is allowed over the prior art of record. 

Priority 

6. Acknowledgment is made of applicant's claim for foreign priority under 35 
U.S.C. 119(a)-(d). The certified copy has been filed in parent Application No. 
09/994,769, filed on November 28, 2001. The Applicant was accorded the benefit of the 
earlier filing date of May 14, 2001. 

Claim Rejections - 35 USC §103 

7. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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8. Claims 3-6 and 8-14 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Katherine Wang (U.S. Patent No. 5,802,361 and Wang hereinafter) in view of 
Kazuyo Ikeda (U.S. Patent No. 6,564,206 and Ikeda hereinafter). 


Regarding Claims 3 and 10-14, Wang discloses 
a data retrieving part retrieving data (Fig 2a, Element 211) 
a classifying and arranging part (the ranking of each image ) for classifying and 
arranging data (image) in the data retrieving part on a display screen (Once the ranked 
images are displayed ) in accordance with feature values (according to the ranking of 
the selected image attributes ) (Col 2, Lines 33-40; see also Col 8, Lines 40-47; see also 
Col 5, Lines 35-51), i.e. 

During retrieval, the ranking of each image according to the 
ranking of the selected image attributes in the search inquiry 
is determined, and the images analyzed and displayed 
according to their rankings in either a spatial order, such as 
a grid layout, or a temporal order, one after another. Once 
the ranked images are displayed , the user can specify which 
images are satisfactory matches for the search inquiry and 
which are not, whereupon a correlation between the image 
attributes in the search inquiry and the designated images is 
determined, the ranking for the image attribute readjusted 
according to their individual correlations, and the search 
repeated with the new rankings. This adaptive process will 
allow the user to quickly identify the desired image or 
images. The user may again search the images for image 
attributes whose parameters have been reset to match the 
image attributes of the images indicated by the user as being 
satisfactory or best matches 
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a ground information 1 2 providing part (side information) providing each data 
(image) with ground information visualizing grounds (Figures 5d-5i, 7-8 and 12 and 
corresponding text) for the classification and the arrangement of the data; and (Col 4, 
Lines 63 through Col 5, Line 25; see also Col 5, Lines 35-38, i.e. ranking; see also (Col 
8, Lines 48-51), i.e. 

Once the search inquiry is constructed 205, the high level 
analyzer 123 parses 207 the search inquiry to determine the 
image attribute included therein, and the order in which the 
corresponding side information files 115 are to be analyzed. 


(Col 24, Lines 64-67), i.e. 

After the high level analyzer 123 evaluates 209 the 
a ppropriate side information files 115 from the image 
database 113, and determines the ordering of those images 
that are substantially similar to the image attributes in the 
search inquiry. 


a display part displaying each data together with corresponding ground 
information (Figures 5b-5h, 5i and 7-8 f in accordance with classification and the 
arrangement of the data (Col 25, Lines 1-3; see also Col 8, Lines 54-66). 


wherein the data retrieving part receives the ground information displayed on a 
display part (Figures 5b-5h, 5i and 7-8); and 


1 The “ground information” can read on the “side information” in accordance to the Application 
specification, please see the Summery of the Invention, Page 3, Lines 20-22. 

The “ground information” can also read on the "image attribute" and how it is visual to the user through 
the Interface and also and how it is ranked (classified). 

2 Please refer to the “image attribute” interpretation above (in the first footnote), and how it can read on 
the “ground information”, please note that this interpretation was mentioned in the first non-final office 
action of November 26, 2003. 
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conducts subsequent search processing by use of the received information as a 
search key (Col 20, Lines 1-16). 

Wang’s reference discloses all of the claimed subject matter set forth above, 
except it does not explicitly indicate the data having similar feature values are disposed 
close to each other. However Ikeda, teaches data having similar feature values are 
disposed close to each other (Ikeda, Figure No. 6 and corresponding text; see also Col 
6, Lines 33-66). 

Given the intended broad application of the Wang’s system, It would have been 
obvious to a person of ordinary skill in the art at the time of Applicant’s invention to 
modify the teachings of Wang with the teachings of Ikeda to include the feature of 
disposing similar images (data) next to each other on a display to increase the system 
flexibility and to make it more user friendly by display similar images next to each other 
that would attract more users which leads to increase in the profits. 

Regarding Claims 4, Wang discloses wherein the classifying and arranging part 
conducts self-organization mapping processing in classification and arrangement 
processing of data (Abstract), i.e. 

“and analyzes the image data of the side information files to 
determine a similarity measure for each image with respect 
to the search inquiry” 

see also (Col 24, Lines 55-62; see also Col 24, Line 64 through Col 25, Line 3), i.e. 
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“such as pointers or storage addresses of the images” 
(mapping); 


see also (Col 6, Lines 22-35), i.e. 


“A high level analyzer analyzes the search inquiry to 
determine the image attributes and their parameters 
contained therein, and then analyzes the image data of the 
images to determine how similar the image data of an image 
is to the image attributes, to retrieve the images that are 
substantially similar to the image attributes of the search 
inquiry”. 


See also Ikeda (Figures 6-8 and corresponding text). 


Regarding Claims 5-6, Wang discloses wherein the label information 3 , the 

information on the feature values is color information, and the distribution information on 

the feature values is color histogram information (Col 3, Lines 44-52; see also Col 4, 

Lines 19-39; see also Col 11 .Lines 32-36), i.e. 

A color histogram side information file includes a color 
histogram of each image, either still images or those that are 
part of video sequences. In the preferred embodiment, the 
color histogram is based on an HSV color space , and 
represents the frequency distribution of colors by their hue 
and saturation levels in the image , with brightness values 
discarded. 


Regarding Claim 8, Wang discloses wherein the data is image data, and in the 
label information, information on the feature values is edge information in image data, 
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and distribution information on the feature values is histogram information including a 
direction of an edge portion in the image data as an element (Col 10, Line 66 through 
Col 11, Line 17. 

Regarding Claim 9, Wang discloses wherein the data is image data, and in the 
label information, the information on feature values is color information, and distribution 
information on the feature values is representative color information (Figure No. 5d; see 
also Col 3, Lines 53 through Col 4, Line 3). 

Allowable Subject Matter 

9. Claim 7 is allowed over the prior art of record. 

10. The following is the Examiner’s statement of reasons for the indication of 
allowable subject matter: 

Regarding Claim 7, Applicant’s particular system in the environment of image 
searching is the feature wherein the data is image data, and in the label information, the 
information on feature values is information on wavelet conversion feature values, and 
the distribution information on the feature values is distribution information on frequency 
components of the image data subjected to wavelet conversion in combination with the 
limitations of the Claim was not disclosed by, would not have been obvious over, nor 
would have been fairly suggested by the prior art of record or that encountered in 
searching of the prior art. 

3 Please note that the “label information” is being interpreted as “color information" or “color space” 
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Response to Arguments 

11. Applicant's arguments filed September 16, 2005 have been fully considered but 
they are not persuasive. 

Applicant argues that Ikeda’s reference does not teach data having similar 
feature values are disposed close to each other. The Examiner however disagrees. 
Tkeda discloses data having similar feature values are disposed close to each other, 
please see (Ikeda, Figure No. 6 and corresponding text; see also Col 6, Lines 33-66). 


Points of Contact 

12. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Haythim J. Alaubaidi whose telephone number is (571) 
272-4014. The examiner can normally be reached on Monday - Friday from 8:00 AM to 
4:30 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Jeffrey Gaffin, can be reached at (571) 272-446. 

Any response to this office action should be mailed to: 

The Commissioner of Patents and Trademarks, Washington, D.C. 20231 or Faxed at 
our central fax number (571) 273-8300. 


according to the Specification of the instant Application (please see Page 4, Lines 11-12). 
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Hand-delivered responses should be brought to the Customer Service Window of the 


Randolph Building at 401 Dulany Street, Alexandria, VA 22314 



Patent Examiner 
Technology Center 2100 
Art Unit 2168 




